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Suirjmry 



This research was conducted in two stages. The first stage 
consisted of applying a theoretical solution to the prohlem of 
progressive effects and treatment interaction cocmionly called 
proximty error to administrations of semntic differential (SD) 
questionnaires. The second stage consisted of ascertaining whether 
or not manipulating various sources of proximity error produced 
discernably different response patterns among Ss completing SD 
questionnaires . 

The objective in stage one was to design a computer program 
such that the output would consist of sets of SD questionnaires. For 
^uy given set of questionnaires from zero to three sources of proximity 
error were to be minimizable at the discretion of E. The three 
sources of proximity error include (l) effects of the order in which 
SD concepts are presented, (2) effects of the order in which SD 
adjective scales are presented, and (3) effects of the order in which 
adjectives appear within a given SD scale. 

A program meeting this objective was created, tested, and used 
for production runs of SD questionnaires. Proximity errors stemming 
from concept order or scale order were minimized by devising a 
subroutine based on a recent theoretical solution of the proximity 
error problem for tests containing as many as 22 items. Thus the 
program can accept at most 22 concepts each of which may be rated on 
at most 22 SD scales. Proximity errors arising frcsn adjecti\’al 
order within a scale were ’uiniiaLzed by applying a random number 
generating subroutine that selects which of the two adjectives to 
print first. The program is organized so that E may use none, one 
or both of these subroutines to control any or all of these sources 
of proximity error . Additionally each SD questionnaire contains a 
set of directions for the respondant. 

Although the program was developed specifically for producing 
SD questionnaires having variable formats, it my be modified to 
produce other sorts of questionnaires or tests in which E wishes to 
manipulate sources of proximity error. 

In stage two of this research three experiments were conducted 
to determine the effects of controlling sources of proximity error on 
responses to SD questiomiaires . In Experiment I responses to SD 
questionnaires in which all three sources of proximity error (concept 
order, scale order, and adjective order within scales) were varied 
were compared with responses to SD questionnaires in which all three 
orders were left invariant. In experiment II the two SD questionnaire 
formats were (l) all three orderings varied and (2) four different 
concept orders, but fixed scale order and fixed adjective order within 
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scales. In 2:-:perir.ent III the Toriaats *.:ere (l) only adjective order 
■'.-’itiion scales controlled and (2) Tour different concept orders, but 
fi::ed scale order and f-ocect ad'^ecciYe order scales. The SD 

oi.es cacnnaares consis'ced of nine concepts each of ■'..’hich ’.^as to be 
rated or. l^i SD scales. 7or each concept ojithin each treatment of 
e?.cn enpera'ient a l4 X l^J- ..n.tri>i of inter correlations was coLiputed, 
factored, and rotated to the Yari *ax criterion. After exa^iining the 
proportion of total variance accounted for by the first four factors 
as Jell as the rotated factor structures further analyses were limited 
to factors I and II. 



ihree measures of difierences between responses to the two 
types of SD questionnaires ware analyzed: differences in rotated 

factor structures, differences in factor scores concept-by- concept, 
and differences on a measure labeled "response consistency." In 
each experiment all measures indicate no significant differences 
in responses oi traceable to questionnaire for- -at manipulations. 
Sub.ject to the constraints on the generalizability of these results 
i o appears that Es need uoz be concerned about proximity error 
eiicci/S irhen adniinistering SD questionnaires. Fixed orderings of 
concepts, scales, and ad-Joctives within scales failed to induce any 
significant differences in response patterns when compared with 

orderings varied in such a way that sources of proxivuity error were 
controlled . 
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Introduction 



The first obiective of this research was to develop a practical 
method of producing a sec of SD questionnaires in which theoretical item 
order effects :?*ay be minimized by using an electronic computer to 
produce the questionnaires. The second objective was to determine the 
effects of controlling various con.binaticns of three distinct sources 
of order bias in SD administrations by using computer generated SD 
questionnaires . 

The body of this report is organized into two sections each 
dealing with those aspects of the research which bear on one of the 
objectives listed above. Each section may be studied independently 
of the other. 



The Computer ft-ogram 



The typical semantic differential questionnaire consists of directions 
to S followed by the first concept with its associated adjectival scales. 
Realizing that progressive effects and treatment interaction known as 
proxiLoity errors may occur, E determines the order and polarity of the 
scales in a random fashion. Thus, while the ordering of the scales and 
their polarity remains invariant throughout the data collection, at 
least the effects are free of E's bias with respect to the variables 
being studied. Order effects among the concepts included are often 
accounted for by presenting the concepts to Ss in several different 
randomly determined orders. The solution, then, has been to take 
account of but not necessarily minimize, proximity error within SD 
questionnaires . 

VRiile the weaknesses of this solution appear obvious, better 
solutions have not been feasible economically in the past. Print shop 
and office duplicating machines are not designed to produce variable 
formats. Moreover, S would not have been sure that he was reducing 
substantially proximity error by having a number of different versions 
of SD questionnaires used in his data collection. Houston (1967) 
has shown that if a sequence of k tasks is varied from S to S, 
proxfmity error will be reduced and if every possible permutation of 
k tasks occurs with equal frequency proximity error would be controlled 

optiiially. However = kl, which increases dramatically as k increases 

there are usually too few S’s available to make an optimum solution 
possible. 

Bradley (l95B), Alimena (1962), and Houston (1966) have reported 
methods of using cyclic Latin squares as generators of reasonably 
small sets of permutations of k tasks having the property of reduced 
proximity error. Houston (1967) designed an heuristic search program 
for the CDC l6o4 computer which inspected random permutations of k 
items (k < 22) to be used to generate cyclic Latin squares such that 
proximity error reduction would be maximized. For k > 6, his results 
represent improvements over earlier techniques of one order of 
magnitude or more. Thus a theoretical solution to the problem of 
proximity error within a sequence of up to 22 tasks is available for 

testing. First columns for Houston’s Latin squares may be found in 
Appendix A. 

While a theoretical solution to the problem of proximity bias 
seems to be available for k < 22 there is no reasonable way to utilize 
these results if ordinary duplicating equipment is used to prepare 
questionnaires. To overcome this difficulty a computer program to 
generate SD questionnaires was developed for the IBM 7094. 
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Specificatij?^ Computer Prograxi 



The program for the production of SD questionnaires takes account 
sources of order efiTects: (l) the order of concept presentation 

the order of the adjectival scales used to measure the meaning of 
each concept; and (3) the polarity of each scale (v 7 hich end is positive). 
Froxinnty errors caused by concept order anc- scale order are minimized 
by using the particular permutation of k items found by Houston to 
generate the k x k Latin square yielding the most favorable index of 
proximity error. Scale polarity is determined scale-t -scale by 
reference to a random digit generating function. 



The output from the computing system’s printer is a set of SD 
questionnaires for as many as 999 Ps. Each questionnaire may be 
composed of at most 22 concepts each of which may be rated on at most 
22 adjectival scales. Each questionnaire includes a standard set of 
directions as suggested by Osgood, Suci, and Tannenbaum (l9J>7) . The 
program is witten so that S r. 2 ay invoke or ignore subroutines designed 
to minimize each tyne of order effect. For example, E may use the 
appropriate Latin square generator to reduce proximity bias due to 
Scale ordering while holding concept order and scale polarity invariant. 

Sample SD questionnaires produced with this program appear in Appendices B, 
C, and D. ^ ^ 

A printout of the program deck appears in Appendix E. Immediately 
following the program deck data cards are inserted. The formats of 
these cards are outlined belovr. 

Card 1 



Columns 1-3 
Columns 4-6 
Columns 7-9 



concept order option 
scale order option 
scale polarity option 



For each of these options: 



a. If any colui'.in in the 3-column field contains a 1, 
the associated svbroutine is ignored. 

b. If all columns in the 3-column field contain anything 
except a 1 , the associated subroutine is invoked. 



Colwims 10-12 
Columns 13-15 
Columns 16 -I 8 



Insert the number of questionnaires 
to be produced (up to 999 ) « 

Insert the number of SD concepts in 
each questionnaire (up to 022 ) . 
Insert the number of scales for each 
concept (up to 022 ) . 



If 10 or more concepts 
Columns 19-24 



are being included: 

(_ _ 12 ), where the number of concepts 
is inserted in coluiiins 20 and 21 . 



v» ♦ 



r 



If fewer than 10 ccncepus are being included: 

Ccl''j.m 10 Blank 

Colimns 20-24 (_ 12) , where the nniiber of concepts 

is inserted in coluirai 21. 



If 10 or r.ore scales are being ir-'lnded: 

Colur/ns 2p-3C ( Tc) where the nuiiber of scales 

is inserted in coloEdis 26 and 27- 



If fewer than 1C scales are being included: 

Coluipn 25 Blank 

Ccluians 26-30 (__ 12) , where the number of scales 

is inserted in coluiai 27- 

Card 2 

Columns 1-11 The first eleven digits from the 

random nuiiber generating subroutine.* 

This card should be changed for each machine run. The 
new eleven digits are to be taken from the last row of the 
preceding printout following the message, "This is a new 
series of tests." If scale polarity is not to be varied do 
not include this card in the data deck. 

Cards 3 through kj 

The instructions to be printed at the beginning of 
each questionnaire are contained in these cards. The contents 
of these cards ..lay be examined card-by-card by referring 
to the appropriate lines in Appendix E. 



Card 4'3 

Concept order for first colui.mi of Latin square"^'^ 
Columns 1 and 2 First concept 

Columns 3 and 4 Second concept 



Columns 2k-l and 2k '-.th concept 

(Vfliere k < 22) 



^'Any raiidom number generating function may be employed by replacing 
the appropriate cards in the program deck and redesigning Card 2 in the 
data deck. The algorithi?. e..'ployed here was to reverse the polarity of 
an adjective pair if the associated random digit was odd. 

-x*Sae Appendix A for a listing of first columns to be used. 
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Card kS 



Scale order f:r first cclarjQ of Latin square**^ 
Ccluinns 1 and 2 first concept 

CoiUTins ?: and ^ Second concept 



Colunms 2k - 1 and 2k 3ith concept 
C/7here k < 22) 

Card 50 through (50 k) , k < 22 

Concept list. One concept per card beginning in coluiTin 1. 

Card ^(50 + k) + through ^((50 + k) + l) + k| 

Scale list One scale per card 

ColuFins I-I 5 First adjective 

Columns 16 - 3 O Second adjective 

Last Card 

Repeat card 1 for a new series of questionnaires. 

While the program was ’.-Tritten with SD questionnaires in mind it 
is quite possible to use it (with a modified data deck) to generate 
tests or questionnaires of various sorts . For example multiple choice 
tests may be produced by using the Latin square generating subroutine 
tv/ice, once for question order and once for alternative order within 
each question. Lists for matching questions inay be varied in the same 
manner. True-false tests may be printed such that proximty error is 
miniiaized . Questionnaires with up to 22^ items may be produced by 
this program. It appears that with little or no modification the 
basic subroutines of the program can be used in a wide range of test 
or questionnaire production applications. 



-See Appendix A for a Usting of first colui^ms to be used. 
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Ccnparing SD S^uesticnnaire Generatii^ Strategies 



The ccapatcr prcgra?.. descri'ced in the preceding section i2akes 
it possible to detect differences in responses attributable to 
order effects on SD questionnaires. This section reports the 
results of studying whether or not reducing sources of proximity 
error changes the response patterns of Ss- 



gxperiiiiental Design 



There are nine SD questionnaire generating strategies. 

Numbeis 1 through 8 comprise all the combinations producible from 
the computer program; number 9 is the standard non-computer-based 
format . 

1. Concept order fixed, scale order fixed, scale polarity fixed. 

2. Concept order fixed, scale order fixed, scale polarity varied. 

3* Concept order fixed, scale order varied, scale polarity fixed. 

4. Concept order fixed, scale order varied, scale polarity varied. 

5. Concept order varied, scale order fixed, scale polarity fixed. 

6. Concept order varied, scale order fixed, scale polarity varied 

7* Concept order varied, scale order varied, scale polarit3'’ fixed. 

8. Concept order varied, scale order varied, scale polarity varied. 

9* A few concept orders, scale order fixed, polarity fixed. 



There are 36 distinct pairs of strategies ( C = • 

of these 36 pairings three were selected as being of prime importance 
in determining the utility of reducing proximity error in research 
employing the SD. The study of each pair is designated as an experiment. 



Experiment I: Strategies 1 and 3. 

These strategies should produce maximum differences with respect 
to effects of proximity error. Response differences here may 
serve as a base line against which to compare differences 
between other pairs. 



Experiment II: Strategies 9 and 8. 

These strategies should produce differences comparable to those 
between SD questionnaires produced in the standard (non-computer- 
based) way and those produced by employing all the format 
variability available by using the computer to generate the 
questionnaires . 



Experiment III: Strategies 9 and 2. 

This pairing provides a comparison between the non-computerized 
questionnaire and one in which only scale polarity is varied. 

If significant differences in response patterns are found 
within the pairings of Experiments II and III, and if the 
differences in Experiment II are comparable to those in 
Sjiperiment III then it would be economically sound tc generate 
SD questionnaires using strategy 2 since it is simpler (thus 
less costly) than employing strategy 8. 
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These toes e;-iperi“.ents v:ere selected because they yculd afford 
enourh infornaticn to be able tc decide whether or not reducing 
oronisiity error prcduces differences in "che response patterns cf 
Ss on uD questionnaires . If it dceq oiiher cairinrs can be examined 
as necessary. If it dees not, ncn-cooputerized production techniques 
T.-.qy be used without continuing concern over the presence cf proximity 
erro>r effects. 



Subjects and Data Collection 

One hundred fifty undergraduate students enrolled in a mathemauics 
course for prospective elementary teachers ^.jere selected as Ss. 

The selection was done randcoily from, five sections of the course having 
a total enrollment of l86 students. The remaining 36 students participated 
in the data collection but their responses were not analyzed. Fifty S^s were 
assigned randoLily to each of the three experiments . Within each 
experiment twenty-five Ss completed a SD questionnaire generated 
by one of the strategies while the remaining twenty-five ^s completed 
a SD questionnaire generated by the other strategy . Assignment 
of Ss to these treatments i7as done randomly. Ten days after the first 
data collection each S completed another SD composed of the same 
concepts and ad,jectiva,l scales but generated by the opposing strategy. 

Thus for each experineiit 50 SD’s of each type were coispleted by the S^s. 

The design of the data collection is depicted below. denotes 

the ith group of randomly selected Ss and SD . denotes an SD constructed 

0 

according to sti^ategy j. 

El : SDi SDj- 

E„ : SD^. SD^ 

R3 ^ SD5 SDg 

R^ : SD^^^ SD^ 

R^ : SD^ 



Each SD questionnaire u-as co>:posed of nine concepts related to 
Tiia'jor curricular areas in the elementary schools, ihey vejTQ language 
arts, iiathematics . science; social studies, teaching children, teaching 
childi'en language arts, teaching children mathex:atics , teaching children 
science, and teaching children social studies. Each concepc was rated 
on l4 scales: gccd-bad , nice-awful , positive-negative , heavenly- hellish , 

optirastic- p essemistic , happy-sad , strong-weak , heav^ ’’- light , ba^-soff;, 
masculine-f eminine , fast-slow , active-passive , hot- cold , and difficult- 






II 



III 

The SD Questionns 



easy . 



and Analysis 



Fifty-four (tv:o treatments K 3 experiments X 9 concepts) X l4 
matrices of product -moment correlations \;ere computed. Each of these 
was factored using principal components analysis. Unities were used 
to estimate ccnriiunality, and each analysis was followed by an orthogonal 
rotation to Plaiser’s (l95S, 19o0) , Varimax criterion. Linear 
correlations were iustified because no systeira,tic norinonotonicity was 
observed ai:iong variables in the matrices. V/hile nonlinear relations 
undoubtedly exist ai-^ong the variables, a linear correlation model 
yields a reasonable measure of the degree of relationship for a 
monotonic relation. 

Tables 1-6 list the proportion of total variance accounted for 
by the set of rotated factors for each analysis. 

The Varimax criterion teimiinated the rotation after two factors 
in 13 of the 5^ analyses, after three factors in 28 cases, and in no 
case were more than four factors rotated. The proportion of total 
variance accounted for by the first two factors ranged from 0.452 to 

0.820. In only one case did factor III contribute more than 10^ of the 
total variance. >Hien third and foiurth factors were rotated they seemed 
to be reoccurances of heavy loadings on first and second factors. In 
fact factor IV seemed to be factor II revisited. It \7as decided to 
use only factors I and II as data sources for this study. 

Throe differences bet'ueen responses to the two types of SD 
questionnaires were analyzed in each experiment: 

1. Differences in rotated factor structure 

2. Differences in factor scores concept-by-concept 

3. Differences in response consistency. 

Each of these will be defined explicitly in its respective section below. 
Factor Structure 

To determine differences in rotated factor structure among the 
strategies, scales with factor loadings > 0.3C were listed for factors I 
and II for each of the 54 rotated factor matrices.- In the case of 
factor I these data then were compressed by recording only those scales 
with loadings >0.30 for eight concepts out of nine. In the case of 
factor II the criterion for final recording of a scale was set at 
loadings >0.30 for seven concepts out of nine. Tables 7 and 8 list 
the scales which survived these screening processes for factors I 
and II respectively. 



•^Recall tliat there are three experiments, each consisting of two 
treatments over nine concepts. 
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Table 1 



Proportion of Total Variance for Rotated Factors 
Experiment I, Strategy 1 



Concept 


I 


II 


Factors 

III 


IV 


CUM 


Language Arts 


.449 


.120 


.087 


- 


.656 


I'kthematics 


• 574 


.093 


- 


- 


.667 


Science 


.567 


.104 


- 


- 


.673 


Social Studies 


.581 


.105 


- 


- 


.686 


Teaching Children 


.474 


.130 


.087 


- 


.691 


Teaching Children Language Arts 


.370 


.158 


.107 


- 


.635 


Teaching Children Mathematics 


.4r," 


.153 


.094 


- 


.664 


Teaching Children Science 


.519 


.149 


- 




.668 


Teaching Children Social Studies 


.61=. 


.084 


- 


- 


.699 



o 



Table 2 



Proportion of Total Variance for Rotated Factors 
Experiment I, Strategy 8 



Concept 


I 


II 


Fac tors 
III 


IV 


CUM 


Lr.nguage Arts 


.^59 


.142 


.100 


- 


.701 


PiatheMatics 


.532 


.134 


■ 073 


- 


.739 


Science 


.614 


.iCo 


- 


- 


.79^ 


Social Studies 


-544 


.110 


.OS5 


- 


.739 


Teaching Children 


- 530 


.119 


- 


- 


.649 


Teaching Children Language Arts 


.402 


.155 


.OO6 


.074 


.717 


Teaching Children Mathematics 


.521 


.112 


. 083 


- 


.716 


Teaching Children Science 


.462 


.125 


.087 


.072 


.746 


Teaching Children Social Studies 


.528 


.100 


.a 34 


.. 


.712 



Table 3 



Proportion of Total Variance for Rotated Factors 
Experiment II , Strategy 9 



Concept 


I 


II 


Factors 

III 


IV 


CU 14 


Language Arts 


.494 


.209 


.090 


- 


.693 


Liathema.tics 


.555 


.084 


.078 


- 


.717 


Science 


.624 


.196 


- 


- 


.840 


Social Studies 


.502 


.111 


.078 


- 


.691 


Teaching Children 


.396 


.121 


.095 


- 


.612 


Teaching Children Language Arts 


.523 


.096 


- 


- 


.619 


Teaching Children Mathematics 


.415 


.122 


.077 


.072 


.686 


Teaching Children Science 


.530 


.104 


- 


- 


.634 


Teaching Children Social Studies 


.530 


.110 


• 

0 

CO 


«Pk 


.718 



T 




r-» 

VJl 



t I 



I 



O 




Table k 

Proportion of Total Variance for Rotated Factors 
Experiment II ^ Strategj'- 3 



Concept 


I 


II 


E actors 
III 


IV 


CUM 


Langiiage Arts 


.468 


.108 


.073 




.650 


flathe-vatics 


.498 


.110 


.C62 


- 


.690 


Science 


.572 


.194 


- 


- 


.766 


Social Studies 


.493 


. 133 


.083 


- 


.711 


Teaching Children 


.i -'32 


.136 


.092 


.075 


.735 


Teaching Children Language Arts 


.442 


.126 


.096 


.080 


.744 


Teaching Children ^^athei;:atics 


.446 


.122 


.073 


.075 


.699 


Teaching Children Science 


.457 


.117 


.034 


- 


.661 


Teaching Child'^en Social Studies 


.475 


.107 


.098 


.074 


.744 



Jt 




Table 5 



Proportion of Total Variance for Rotated Factors 



Experiment 


III, 


Strategy 


0 






Concept 




] 


j’actors 








I 


II 


III 


IV 


CUM 


Language Arts 


531 


.129 


.081 


- 


.741 


iJlathev-iatics 


580 


.087 


- 


- 


,667 


Science 


645 


.134 


•to 


- 


.779 


Social Studies 


.534 


.104 


.077 


- 


.715 


Teaching Children 


.537 


.106 


.078 


- 


.721 


Teaching Children Language Arts 


.452 


.122 


.084 


- 


.658 


Teaching Children Matheuiatics 


.417 


.148 


-077 


- 


.642 


Teaching Children Science 


.461 


.121 


.091 


- 


.675 


Teaching Children Social Studies 


.443 


.137 


.093 


.077 


.750 




Table 6 



Proportion of Total Variance for Rotated Factors 
Experiment III, Strategy 2 



-<3 



Concept 



Iw'.nguage Arts 

iylathematics 

Science 

Social Studies 
Teaching Children 
Teaching Children Language Arts 
Teaching Children Mathematics 
Teaching Children Science 
Teaching Children Social Studies 



Factors 



I 


II 


III 


IV 


.476 


.111 


,100 


- 


.536 


.094 


.078 


- 


.573 


.175 


- 


- 


.428 


.098 


.094 


.078 


.440 


.116 


.090 


.072 


.440 


.109 


.080 


- 


.304 


.148 


.126 


.104 


.449 


.095 


.076 


- 


.398 


.l4o 


.095 


.078 



CUM 

.687 

.708 

.743 

.699 

.718 

.629 

.682 

.620 



.712 



Table 7 

Scales With Factor I Loadings >0.30 In 
At Least 45 out of 54 Cases 



Questionnaire Generating Strategy 
12 8 9 


heavy-light 










active-passive 


X 




X 


X 


happy- sad* 


X 


X 


X 


X 


heavenly-hellish* 


X 


X 




X 


fast-slow 


X 








positive-negative* 


X 


X 


X 


X 


difficult-easy 










opt i;ni s t i c -pes s imi s t i c* 


X 




X 


X 


strong-weak 


A 


X 


X 


X 


hard-soft 










nice-awful* 


X 


X 


X 


X 


hot -CO Id 


V 

A 




X 




gpod-bad* 


A 


X 


X 


X 


mas culine-f eminine 










*Denotes scales traditionally 


associated with factor I in SD 


research. 
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1 

I 

I 

1 

i 

I 

I 

I 

I 

I 

I 

i 



! 

I 

I 

I 

1 

I 

I 

I 



I 

I 



f 




T^ole I- 

Scales With Factor II Leadings > O.SO In 
At Least Cut of Cases 



hea''/y- light 
active -passive 
happy- sad 
heavenly-he llish 
fast- slow 
positive-negative 

difficult-easy 

opt ivAs t i c -pe s s irai Stic 

strong-^/eali 

hard-soft 

nice-a^7ful 

hot-cold 

good -bad 

raasculine-feininine 



Questionnaire Generating Strategj^ 

12 8 9 

XXX X 



V 



■xr V V 

J\. A 



X 



Tr 

A 



X 



V 

A 



X 
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In ToDle 7 there are (i.e., h strategies X scales) cells in 
which a tally isark can appear, hy changing the entry in iast six of 
these cells identical iiatchingc cculd be created in all four strategy 
celimns. Indeed, identical narkings already exist for nine of the 
l^i scales. Of the six traditional factor I scales, four survived the 
screening procedure under all four strategies; the renaining two 
survived under three out of four strategies. Although the strategy 2 
column exhibits the greatest deviation from the other columns. Table 7 
argues on the side of marked siLiilarities among the columns rather 
than marked differences. 

By changing only tv70 entries out of 56 in Table 8 matchings in 
all four strategy columns could be created. With che possible exception 
of factor I, strategy 2, there seems to be no appreciable differences 
in factor structure among the four questionnaire generating strategies 
for either factor I or factor II. 

Factor-Scores 

On the basis of the factor structure summarized in Tables 7 and 8 
five scales were chosen to represent factor I and three scales were 
chosen to represent factor II. For factor I the scales selected 
were happy- sad , positive-negative , strong-weak , nice -awful , and good -bad . 
For factor II the scales were heavy- light , difficult-easy , and hard- soft . 

A score from 0 to 6 was recorded for each S on each scale and a 
mean score on factor I scales as well as factor II scales was computed 
concept-by-concept withjn each experimental treatment. Thus vjithin 
each experiment there were nine pairs of mean scores for factor I and 
nine pairs of mean scores for factor II. Each pair contained two 
mean scores for a given concept one of which arose from SB questionnaires 
generated by one strategy \7hile the other came from SD questionnaires 
generated by the opposing strategy. The difference between mean 
scores within each pair was analyzed by an analysis of variance model. 

Tables 9-11 list the F ratios emanating from experiments I, II, 
and III respectively. 
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Table 9 



F Ratios for AIIOVAs : Experiment I 

(strategic 1 vs . Strategj*' 8) 



Concept 


Factor I 


Factor II 


Language Arts 


1.810 


0.844 


I'lathsr^tics 


1.881 


1.715 


Science 


0.051 


0.717 


Social Studies 


2.843* 


0.524 


Teaching Children 


0.?46 


1.246 


Teaching Children Language Arts 


0.346 


0.280 


Teaching Children Llatheraatics 


0.9^5 


0.000 


Teaching Children Science 


0.026 


0.006 


Teaching Children Social Studies 


0.377 


0.006 



Significant at c = 0.10. None of these F ratios is significant 

at c =0.05. 
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Table iO 



F iiatios for AliOVAs: Experiment II 

(strategy 8 vs. Strategy 9) 



Concept 


Factor I 


Factor II 


Language Arts 


0.258 


0.067 


Mathematics 


0.508 


0.197 


Science 


0.646 


1.449 


Social Studies 


1.114 


0.829 


Teaching Children 


2.173 


2.767* 


Teaching children Language Arts 


0.580 


1.294 


Teaching Children l^theraatics 


0.256 


0.375 


Teaching Children Science 


0.007 


0.401 


Teaching Children Social Studies 


0.098 


0.181 



Significant at c.' = 0.10. None of these F ratios is significant 



at c = 0.05. 
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Table 11 

F Ratics for AI'CV.As: E'lperitient III 

( St rate, 53'’ 2 vs . Strategy 9) 



Concept 


Factor I 


Factor II 


Language Arts 


0.064 


0.4l8 


l*Iather;iatics 


0.039 


0.146 


Science 


0.602 


0.054 


Social Studies 


0.050 


0.336 


Teaching Children 


0.008 


0.803 


Teaching Children Language Arts 


0.330 


1.200 


Teaching Children Liathematics 


0.788 


2,863* 


Teaching Children Science 


0.002 


1.126 


Teaching Children Social Studies 


0.792 


1.774 


Significant at a = 0.10. None 


of these F ratios is 


significant 



at c = 0.05. 



2? 



'JL ^ 



Ci* :'U r rutics Tc-.c-les sibiilficarit 

= ..0/ I-ival; or._'* i/.r’i": 2 i-riii:‘i^’^nz ut -L'- • = O.lO. In 

fact C..1: si.:: as 2 si::. car." r -level Isjalr^nced tc 

0.1*1. r .I'tj cx ”he 5*- f vaOi-is are "'ess tr.an 1.^-^.'. rl.ese daxa su?>iess 
tLat .v. cysaei-atlc difi'ereaccc is lactcr sc:res sccvr in any cf the 
e::teri- .sn is . 



Bes':c:~.S 2 C-nsistency 



dii* 'erences between straterses a direct 
:;Sisteric;v ” '..'as devised. This ueasure 
aestlc-n: ilo:: clcsel” lees S*s response 



As a final readir.:: : i 
‘ 2 C 1 :f*‘>ated 'res'cc r.s 
see'.s wj ansver the f'_12r'.:i 
on the (n .:)th adiectlve 
ad-"ective scale: Tz ansvrer chis questicn the abselute va3.ue cf the 

diiterence *set''.reen the scire .-n scale n and scaie n -i v:as selecteo 



:cale ccT.i'vri;. tc his response cn the nth 



as the measure. Thus 



C = 



n 



- s 



n 



id 



14-h 



*.:her5 



denotes a 



s ^ denotes the score on scale ^ 



response consistency inde::^ 
denotes the score on scale (n ; and |s - s ^,_j as suiried 



over all such differences 'jithin a given concept. Clearly, the 
sivaiation could be ciade cf all such differences produced by a given 
S across concepts if one ■'.rished to do so. Sui-urj-ng i^ithin concepts 
a^nd across Ss 'jas done to conforva vjith the other analyses ..lade in 
this study.” It vjas decided to let k =1, 2, 3, or 4. Thus four 
distinct C’s were coi.-puted for each concept. Ifnen :: = 1, differences 
betifeen scores for ad.jacent scales are involved. Since there were 
l4 scales in all, 13 difference scores are accumulated for each S 
on each concept. I'/lien k = 2, differences between scores on scales 

1 and 3, 2 and 4, , 12 and l4 are accui..ulated. In this case 

2 ,re 12 difference scores for each ^ on each concepo. SiriUaxly, 
when k = 3, there are 11 difference scores per concept per S and 
when there are 10 difference scores per conce^Dt per 

By using l4-k in the denov*inator the four response consistency measures are 
transfered into comparab3.e indices . 



If the basic hypothesis 
then vie can assume that diff 
differences when k = 2 and. 



of proxiviity error ef ?ects is operative 
erences when k = 1 should be less than 
in general ^ ^2 ^ ^ ^4^ where 



the subscript digits refer co the value for k. Table 12 displays 
response consistency indices for k= 1, 2, 3j and 4 for each concept 
fro:.i 200 of the SD questionnaires completed by Ss in this study. 
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Table 12 

Response Consistency Indices frcn 
200 SD Questionnaires 











G 










0 


















CO 


XS 


0 






0 


f-H 


-P 






•H 


•H 




CO 




XJ 


s: 


< 


o 




G 


o 




•H 




-P 




0 


-P 




CO 


to 


to 




0 




G 


d 




o 


r-I 


•H 


G 


■q3 


G 


G 


.G 


tD 


r-» 

« 


C) 


•H 


O 


G 




•H 


O 


o5 


c5 




O 


O 


0 






CO 


CO 





-P 

0 

tD 



to 

c 



G 

0 

I — 1 

•H 

o 

to 

G 

•H 

o 

c5 

(D 

EH 



Cl 

o 

•H 

-P 



0 

-p 



G 

0 

XJ 

rH 

•H 

;g 

o 

tjj 

G 

•H 

;g 

a 

g3 

0 

EH 



0 

a 

G 

0 

•H 

O 

CO 

G 

0 

f-H 

•H 

o 

to 

G 

•H 

o 

a 

0 

EH 



w 

0 

•H 

-P 

CO 

f-H 

Cj 

•H 

O 

o 

CO 

G 

0 

5^ 

t — I 
•H 

O 

to 

G 

•H 

;g 

O 

g3 

0 

EH 



1 


356.. 2 


356.8 


266.2 


332.7 


399.2 


355.1 


312.2 


313.1 


328.7 


2 


331.6 


364.3 


274.5 


317.5 


339.1 


317.3 


311.8 


3G4.7 


294.0 


3 


323.2 


342.0 


266.4 


299.4 


548.6 


318.0 


312.1 


297.8 


302.8 


4 


358.3 


357.1 


272.3 


331.6 


351.3 


348.0 


316.6 


315.7 


328.5 



O 

ERIC 



:\n inspection c-f' the nine oclui.ns ot I’able 12 ices not support the 
existance of the order relation. 




In four out of nine ccluirjis is the largest of the ent-rics. In 

three out of nine coluEins C I , — j> ullC largest of the entries. In order 

to determine whether rew or columnar differences are significant a 
two-^.jay analysis of variance '■•as performed. Table 13 includes the 
relevant data. 



Table 13 

MOVA for Comparing Four 
Response Consistency Indices Across 
Nine SD Concepts for 200 SD Questionnaires 



Source of Variation 


Sum of 
Squares 


Degrees of 
Freedom 


Mean 

Square 


F 


Response Consistency 


14.12 


0 


4.71 


10 . 5 - 


Indices for k = 1, 2, 3? and 4 










Concepts 


116.58 


8 


14.57 


32.4->^ 


Interaction 


11.01 


24 


0.46 


1.0 


Within Cells 


3251.88 


7164 


0.45 





Significant at c: = 0.01 



The inequality of the indices across concepts suggests that the 
magnitude of the response consistency indices is related to the 
concept being rated, labile the F ratio associated with within-column 
differences suggests that ^2 ^ ^3 ^ systematic order 



relation among C^, C^, C^, and C^ was observed. The fact that C^^ is 

always first or second in size and that C^ is always third or fourth 

in size is the only consistent pattern of note among the columnar entii es 
in Table 12. There is no evidence of concept-index interaction. Thus 
while there are differences in response consistency these differences 
do not appear to be interpretable as indicators of proximity error 
effects based on adjective scale presentation order with the SD concepts 
and scales used in this research. 
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Ccnciusicns and Recc!rr.endations 



Responses tc r. SD ccncirtiac :ii’ nine ccncpTtr.s ratca on 

1^1- scales '.:ere analysed to ieteniine whether or not differences 
attributable to order effects are discernable. The basic question 
was: Does reducing scurccc of proximity error change the response 

patterns of Ss? Three enperiirents were conducted. 2ach one conpared 
responses of to tvjc ccnputer generated foriiis of a SD. In Experiment I 
one forn of the SD niini;.iizad order effects bj'’ varying concept order, 
scale order, and the order of adjective presentation within a scale 
while the alternate forr. held each of these orders fixed. In Experiment II 
one form of the SD varied all three orderings while the alternative 
form held scale order and adjective order within scales fixed but 
presented the nine concepts in four different orders each determined 
randomly. In Experiment III one form of the SD had fixed concept and 
scale orders while adjective order within scales was varied while the 
other form exhibited fixed scale and within scale adjective orders but 
offered four different concept orders each determined randomly. 



One hundred fifty Ss \iere selected at random from a population 
of 1-35 prospective elementary teachers enrolled in a Liathematics course. 
Assignment of Ss to experi.-’ents and treatment groups within experiments 
was done randomly. 

In each experiment three ways in which responses might differ 
were analyzed. These included differences in the rotated factor 
structures of the SD data, differences in factor scores concept -by- concept, 
and differences among indices of response consistency. The results from 
all three ways of searching for differences due to order effects were 
unequivocal . 



a. There vjere no appreciable differences in factor structure 
among the four SD questionnaire forms for factors I and II 
(the only factors analysed) . 

b. There were no significant differences in factor scores for 
factors I and II bet^jeen opposing SD questionnaire formats 
in any of the three e:;q)eriments . 

c. The differences in response consistency indices do not seem 
to be interpretable as indicators of item order effects. 

In short, this research supplied no evidence that users of the 
SD need to be concerned about item order effects as a significant 
source of error variance. In -.'.periment I, where one treatment invited 
r.iaximui'.: order effects and the other treatment minii'Aized the sources 
of these effects from all three orderings (concept order, scale order 
and adjective order within scales) no significant response differences 
were observed. In ExperiViients II and III, where the opposing SD 
foriiiats were less profoundly different, the same result obtained. 



Subject to the usua] cousbraints on the generalizableness of 
finuinjs ic appears that Ss ;.ay cease vrorryinc about the effects of 
a constant itei.i presentation crclering uhen administerinc the SD. 

The efiect oi using a Liodification of the coniputer prograi‘.i described 
in the first section of this repov*t to reduce proxiv.iity error with 
other types of questionnaires and bests remains to be assessed. 
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An heuristic strategy 



s e'i .ployed by Houston ( 19^*7) iu using 
a CO'., puter to search for a permutation cf ■: i'cei.'r. such lhat the 
k X k cyclic Latin square generated by the per5;iutation Minimized 
pror.r'ity error in a test cintaining 1: iliems. The best permutations 
for k = 2, 3j •") 15 ^ 1--; l?j l^h-> 20 j 22 four;d by this procedure 
are reproduced belcv;. 
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Appendix B 



This appendix consists of a facsinile of a SD questionnaire 
produced by a computer. The questionnaire has concept order, scale 
order, and scale polarity all varied. Thus successive questionnaires 
from this production run were produced with different concept orders. 
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-■ . f .- » - .■ 

OF THl 



STLDV 



-0I1S- R£C&L£-8:J£-m\t^S?vG TH£H 



iS Tt Fi:A;>LkE Thli MCA^H.VGS OF CERTAIN THINGS TO VARI 
JUDGE THEM AGAINST A SERIES GF DESCRIPTIVE SCALES. 



IN TAKING TFIS TEST, PLEASE f^A<E YOUR JUDGEMENTS CF THE BASIS OF WHAT THESE TH 
INGS PEAN TC^ YCU. ON EACH P ^GE OF THIS BCOKLET YCU WILL FIND A DIFFERENT CONC 
EPI TC BE JLDGEC AND BENEATH I" A SET OF SCALES. YOU ARE TO RATE THE CONCEPT 
CN EACF CF THESES SCALES IM QRCtR* HERE IS HCW YCU ARE TO USE THESE SCALES. 

IF TOL FEEL THAT THE CCNCEPT AT THE TOP OF THIS PAGE IS VERY CLOSELY RELATED 
TQ CNE ENC OF THE SCALE* YOU SHOULD PLiCE YQUR CHECK HARK AS FOLLOWS 



/ / / / UNFAIR 

/ / / /X UNFAIR 

IF YOL FEEL THAT THE CONCEPT IS QUITE CLOSELY RELATED TO ONE OR THE OTHER END 
CF THE SCALE tBilT NET EXTREKElY)* YCU SHOULD PLACE YOUR MARK AS FOLLOWS 



FAIR X / 
CR FAIR / 



STPCNG 


/ X 


/ 


/ 


/ 


/ 


/ WEAK 




OR 


STRCNG 


/ 


/ 


/ 


J 


y X / 


WEAK 



IF THE CCNCEPT SEEMS CNLY SLIGHTLY REi ATEO TO ONE SIDE AS OPPOSED TO THE 
CTHER SIDE -{BUT IS NCT REALLY NEUTRAL)* "HEN YOU SHOULD CHECK AS FOLLOWS - 



ACTIVE 


/ i i 


/ 


/ / 


PASSIVE 


OR- 


ACTIVE / / 


/ 


J y. / 


/ PASSIVE 



THE DIPECTICN TCWARO WHICH YOU CHECK (OF COURSE) DEPENDS UPON WHICH OF THE THE 
ENDS CF THE SCALE SEEP MOST CHARACTERISTIC GF THE THING YOU ARE JUDGING. 

IF VOL CCNSIOER T.ic CCNCEPT TO BE NEUTRAL ON THE SCALE* BOTH SIDES OF THE 
SCALE EQUALLY ASSOCIATED WITH THE CONCEPT* OR IF THE SCALE IS COMPLETELY 
IRREVElcNT UNRELATED TO THE CONCEPT, THEN YOU SHOULD MARK THE SCALE AS 

FOLLOWS 
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/ DANGEROUS 



«IOOU OF THE SPACES, NOT ON THE 
/ 

FOR EVERY CONCEPT DO NOT OHIT 

MARK ON A SINGLE SCALE. 

SCMETiMES YOU KAY FEEL AS THOUGH YOU HAVE HAC THE SAME ITEM BEFORE ON THE 
TEST. THIS WILL NOT RE THE CASE, SO DO NOT LOOK BACK AND FORTH THROUGH THE 
ITEMS. DC ^OT TRY TC REMEMBER HOW YOU CHECKEC SIMILAR ITEMS EARLIER IN THE 
TEST. DO NCT WORRY CR PUZZLE OVER INDIVIDUAL ITEMS. IT IS YOUR FIRST IMPRESSI 
CNS, TFE IMMEDIATE FEELINGS A3CUT THE ITEMS, THAT WE WANT. ON THE OTHER HAND 
PLEASE DC NCT BE CARELESS, BECAUSE WE WANT YOUR TRUE IMPRESSIONS. 



SAFE / / / X / / 



U5PCRTANT XI) PLACE YOUR CHECK MARKS IN THE 

BOUNDRIE5 / / X 

(2) BE SURE YOU CHECK EVERY SCALE 
ANY 

(3) NEVER PUT MORE THAN ONE CHECK 



4 



o 



T F \ C ^ I "'i Z 



V. ^ 1 if 






active 


/-- 


^ ^ / 






— /- 


/ 




/ 


PASS! VE 


H/5FP'f 




i 








/ 




— / 


SAD 


PC $ r T I vt 


/ 


i 














NEGATIVE 


8AC 


/ — 


/ 




— / 




/ 




--/ 


6G00 


HEILI SH 


/— 


— / — 


— / — 






/ 




— / 


HEAVE NLV 


FEMM ^E 


/__ 




i 






/ — - 






MASCLLiNP. 


SLCi* 


/ — 
















FAST 


FE/5W 


/ — 


->-/ — 


/— 


— / 


— /- 


/ 


* — 




LIGHT 


PESSinSTIC 


/— 






/ 










OPTIMISTIC 


iSKFLL 


/— 






/ 




/ 




/ 


NICE 


FARC 


/— 






# 










SOFT 


HCl 


/ 
















COLD 


EASV 


/““ 





/ 






/ 




/ 


;)!FF!CLLT 


VFAK 


















STRONG 



ERIC 
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SCCIAl STUCIES 



PCSI T !VE 


/ — 
















MEGATI Ve 


iihFU 


/ — 














— / 


NICE 


H/JPPY 


/— 


— / — 


— / 












SAO 


HCl 


/— 
















COLO 


F^St 


/— 
















SLOV< 


FARC 


/— 
















SOFT 


V^EAH 


















STRONG 


PESSIMISTIC 


/--- 
















OPTIMISTIC 


ACTIVE 


/— 
















PASSIVE 


C IFFICLLT 


/— 
















EASY 


FEAW 


/— 


f 














LIGHT 


FEMMNc* 


/— 
















MASCLLINE 


HELLI SH 


/ — 
















HFAVENLY 


SAC 


/ — 
















GOOD 



TC-ACHifiG CHiLCK’^^'J 



SAC 


/ 
















HAPPY 


EASY 


/ 






r 










0 IFF ICtLT 


AWFIL 


/ 
















MICE 


PASCliLlAfc 


/ 
















FEMIMIME 


STRCNG 


/ 
















VtFAK 


LIGHT 


/ 
















HEAVY 


GGCC 


/ 
















BAD 


ACT IVE 


/ 
















PASSIVE 


PCSITIVE 


/— 
















NEGATIVE 


H6LLI SH 


/— 
















HEAVENLY 


CPTIF^ISTIC 


/— 
















pPSSif^ISTIC 


LABC 


/ 




— / 












SOFT 


FAST 


/— 
















SLOU 


COLE 


/— - 
















HOT 
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TEACHING CHILCKSN SCCIAL STUC16S 



AV<FLL 


/— 
















NICE 


i-ea\,fnlv 


/— 
















HELLISH 


EASV 


/*-■ 
















CIFFICLLT 


hARC 


9 
















SOFT 


GCCC 


/“■ 
















BAD 


CPTIMSTIC 


/- 
















PESSIMISTIC 


HC1 


/- 
















COLD 


AEGATI VE 


/- 
















POSITIVE 


HAPPY 


/- 
















SAD 


FAST 


/- 




/- 


/ — 


/- 




f 


— / 


SLOVs 


PASSIVE 


/- 




#■ 












ACTIVE 


HEAVY 


/- 
















LIGHT 


STRCNG 


/- 
















WEAK 


PASCULINE 


/- 
















FEMININE 



ERIC 



language akts 



CIFFiCtLT 


/ 




* 












EASY 


FAST 


/ 
















SLOW 


HELLISH 


/ 
















heavenly 


LIChT 


/ 














— / 


HEAVY 


HCT 


“ 
















COLO 


PASSI VE 


/“ 
















ACTIVE 


FEMM NE 


/— - 
















MASCLL INE 


SAC 


















HAPPY 


AViFU, 


















NICE 


STPCiNG 


/— - 
















WEAK 


NEGATIVE 


/— 
















POSITIVE 


CPTIf'ISriC 


















PESSI^<ISTlC 


BAC 


/— - 
















GOOD 


fapc 


/— 
















SOFT 
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NATHe^ATlCS 



hEAVENLY 


/— 
















HELLISH 


STRCNG 


/— 














4 


WEAK 


FAST 


/— 
















SLOW 


PESSIMISTIC 


/— 
















OPTIMISTIC 


FEMININE 


/— 
















MASCLLINE 


PCSITIVE 


/— 
















NEGATIVE 


SCFT 


/-*- 
















HARD 


NICE 


/-- 
















AWFUL 


CIFFICUT 


/— 
















EASY 


GCCC 


/— 
















BAD 


SAC 


/-- • 
















HAPPY 


ACTIVE 


/-— 
















PASSIVE 


CCLC 


/— 
















HOT 


LIGHT 


/— 
















HEAVY 
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SCIENCF 









/ 












SLOW 


FAST 


/— ■ 
















GOOD 


8AC 


/— 


















STRCNG 


/— 


— 






--/ 






— / 


WEAK 




















ACTIVE 


PASSIVE 


/“** 
















SOFT 


HARE 




— / — 














HAPPY 


SAC 


















LIGHT 


feavv 


















CTFFICLLT 


EASY 


/— 


















FEAVENIY 


/- 
















HELLISH 




















COLD 


HCT 


i- 


















AWFU 


/- 
















MICE 




















negative 


PCS! TIVE 


/- 
















MASCtLlNE 


FEMMNE 


/- 
















PESSIMISTIC 


CPTINISTIC 


/' 
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/— 










4 






STRONG 


COLC 


/-“ 
















HOT 


GCCC 


/— 
















BAD 


PCSITIV.E 


/— 
















NEGATIVE 


LIGHT 


/ — 
















HEAVY 


NICE 


/— 
















AWFUL 


CPUPI STIC 


/— 
















PESSIMISTIC 


HELLISH 


/— 
















HEAVENLY 


FAST 


/— 
















SLOW 


PASCLLINE 


















FEMININE 


CIFFICLLT 


















EASY 


H.AFPY 


/— 
















SAD 


FARC 


/— 
















SOFT 


ACTIVE 


/— 
















PASSIVE 
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TFACHliNG CHfLCREN L/iMGOAGE ARTS 



GCCC 


/ 
















RAO 


NASCULINF 


/— ■ 
















FEMININE 


COLC 


/-*- 
















HOT 


SAC 


/ — 
















HAPPY 


PESSmSTIC 


















OPTIMISTIC 


EAS> 


/— 
















DIFFICULT 


ACIIVE 


/— 
















PASSIVE 


SLC^ 


/-- 
















FAST 


STPCNG 


/-- • 
















WEAK 


SCF-" 


/— 
















HARD 


HELLI SH 


/— 
















HEAVENLY 


NICE 


/'"■ 
















AWFUL 


FE/iVY 


/-- 
















LIGHT 


AEG/»Tf VE 


/-- 
















POSITIVE 
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Appendix C 




This fansinille SB quest! crnaire has 
concept order and scale order are fixed. 



scale polarity varied ■'.-.’hile 













I 




^3 



THE PURPOSE OF THIS STUDY IS TC PFASURE THE MEANINGS OF CERTAIN THINGS TO VARl 
CUS PECPLF QY HAVING THEM JUDGE THEM AGAINST a SERIES OF OESCRIP'iIVE SCALES. 

IN TAKING THIS TEST, PLEASE MAKF YOUR JUDGEMENTS CF THE BASIS OF KHAT THESE TH 
INGS MEAN TC YOU. ON EACH PAGE OF THIS BOOKLET YOU WILL FIND A DIFFERENT CONC 
EPT TC BE JUDGED AND BENEATH IT A SET OF SCALES. YOU ARE TO RATE THE CONCEPT 
CN EACH OF THESES SCALES in ORDER. HERE IS HOW YOU ARE TO USE THESE SCALES. 

IF TOf FEEL THAT THE CONCEPT AT THE TOP OF THIS PAGE IS VERY CLOSELY RELATED 
TO CNF END CF THE SCALE, YOU SHOULD PLACE YOUR CHECK MARK AS FOLLOWS 





FAIR X 


/ 


/ 


/ 


/ 


/ 


/ UNFAIR 


OR 


FAIR 


/ 


/ 


/ 


/ 


/ 


/ X UNFAIR 



IF YOt FEEL THAT THE CONCEPT IS CUITE CLOSELY RELATED TO ONE OR THE OTHER END 
OF THE SCALE (BUT NCT EXTREMELY), YOU SHOULD PLACE YOUR MARK AS FOLLOWS 

STRCNG / X / / / / / 1^-AK 

OR STRCNG / / / / / X / WEAK 

IF THE CONCEPT SEEMS CNLY SLIGHTLY RELATED TO ONE SIDE AS OPPOSED TO THE 
OTHER SIDE IBUT IS NCT REALLY NEUTRAL), THEN YOU SHOULD CHECK AS FOLLOWS 

' 

ACTIVE / / X / / / / PASSIVE | 

OR ACTIVE / / / / X / / PASSIVE i 

THE OIRECTICN TOWARD WHICH YOU CHECK (OF COURSE) DEPENDS UPON WHICH OF THF TWO 
ENOS CF THE SCALE SEEM MOST CHARACTERISTIC OF THE THING YOU ARE JUDGING. 

IF YOU CCNSIOER THE CCNCEPT TO BE NEUTRAL ON THE SCALE, BOTH SIDES OF THE 
scale equally associated with THE CONCEPT, OR IF THE SCALE IS COMPLETELY 
IRREVELENT , UNRELATED TO THE CONCEPT, THEN YOU SHOULD HARK THE SCALE AS 
^ FOLLOWS 



SAFE / / / / / / DANGEROUS 

IWPCRTANT (1) PLACE YOUR CHECK HARKS IN THE HIOCLE OF THE SPACES* NOT CN THE 

BOUNDRIES / / ^ 

C2) BE SURE YOU CHECK EVERY SCALE FOR EVERY CONCEPT DO NOT OMIT 

ANY 

(3) NEVER PUT PORE THAN ONE CHECK MaRK ON A SINGLE SCALE. 



^CMETIPES YOU MAY FEEL AS THCUGF YCU HAVE HAC THE SAME ITEM BEFORE ON THE 
TEST. THIS WILL NOT BE THE CASE, SO DO NOT LOOK BACK AND FORTH THROUGH THE 
ITEHS- 00 NOT TRY TC REMEMBER HCW YOU CHECKED SIMILAR ITEMS EARLIER IN THE 
TEST. DO NOT WORRY CR PUZZLE OVER INDIVIDUAL ITEMS. IT IS YOUR FIRST IMPRESSI 
CNSt the immediate FEELINGS ABOUT THE ITEMS, THAT WE WANT. ON THE OTHER HAND 
PLEASE DO NCT BE CARELESS, BECAUSE WE WANT YOUR TRUE IMPRESSIONS. 



i 



o 

ERIC 
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1 

I 



I 



HEAVY 

ACTIVE 


/ 

/ 




SAC 






HELUSH 


/ — - 


_/ — / — / — / — / — / — / 


FAST 


/ 




PCSITIVE 


/ — 




EASY 


t ^ 

/ 


/ / / / / / 


CPTIMiSTIC 


/ 




STRONG 


/ 




SOFT 


/ 




AWFUL 


/-- 




COLO 


/ 




GCCC 


/— 




MASCULINE 


/ — 





LIGF.4 

PASSIVE 

HAPPY 

heavenly 

SLOW 

NEGATIVE 

difficult 

pessimistic 

WEAK 

HARD 

NICF 

HOT 

BAD 

FEMININE 
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mathej^atics 



HEAVY 

PASSIVE 

SAC 

HEAVENLY 

FAST 

NEGATIVE 

EASY 

PESSIMISTIC 

STRCNG 

SCFT 

AWFCL 

HCT 

6CCC 

FEMININE 



/ / / / / / / / 

/ / / / / / / / 

/ / / / / / / / 

/ / / / / / / / 

/ / / / / / / 

/ / / / / / / / 

/ / / f /— — / / / 

/ / / / / / f f 

/ / / / / / / / 

/ / / / / / / / 

/ / / f / / / / 



LIGHT 

ACTIVE 

HAPPY 

HELLISH 

SLOW 

POSITIVE 

DIFFICULT 

OPTIMISTIC 

WEAK 

HARD 

NICE 

COLD 

BAD 

MASCULINE 



TEACHING CHILDREN KiATHEPAT ICS 



LIGHT 

ACTIVE 

SAD 

HEAVENLY 

FAST 

NEGATIVE 

EASY 

CPTIHISTIC 

STRDNG 

SOFT 

NICE 

HCT 

GCCD 

FEMININE 



/ / / / 1 / / / 

/ / — *— / / / / / / 

/ / / / / / / / 

/ / / / / / / / 

/ / / /- / / / / 

/ / / / / / / / 

; / / / / / / / 



HEAVY 

PASSIVE 

HAPPY 

bELlISH 

SLOH 

POSITIVE 

DlFFlCtlT 

PESSIMISTIC 

WEAK 

HARO 

AWFUL 

COLO 

BAD 

MASCULINE 



LANGUAGE ARTS 



LICHT 


/ 
















HEAVY 


PASSIVE 


/ 


-/ 














ACTIVE 


SAC 


/ 
















HAPPY 


HEAVENLY 


/ 


-/ — 














HELLISH 


FAST 


















SLOW 


/■** — 
















PCSITIVE 






/ 












NEGATIVE 


/ 
















DIFFICULT 


/ 


9 


9 


' *■ # 


- 






/ 


EASY 


CPTIPISTIC 


/ 
















PESSIMISTIC 


STRONG 


/ 


-/ 












— / 


ViEAK 








/ 








-- / 


— y 


HARD 


SCrT 


/ * 










* / ■“““ 




# 


NICE 


/ / — 


/- 











— / 


AWFUL 


COtQ 


/ 





— 


/ 


-/ 


-/ 




— / 


HOT 


COCO 


/— 


-/ 














BAD 


FEf'ININE 


/ 


-/ /- 


/ 









— / 


MASCULINE 



SCIENCE 




HEAVY 


/— 




_/ /_ 




— / /— 


— / 


LIGHT 


DA €< t UC 


$ 


/ 








/ 


ACTIVE 




/ 


/ 








/ 


HAPPY 


/— 












SAD 


HELLISH 


/— 








— / /— 


— / 


HEAVENLY 


Cl r.w 








/ 




— . / 


P A <^T 


C UL'H 


/ 


/ 




/ 




/ 


■* f 


PCSITIV6 


/-- - 




/- 


-/- 


— / — /— 


— •/ 


NEGATIVE 


DIPFICtLT 


/— 




— / / — 




— / — / — 


— / 


EASY 


PESSIMISTIC 




— / — 


— / / — 


--/-- 


~^/ — /“*"* 


— / 


OPTIMISTIC 
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/ 


STRONG 


* C * * 






/ / 




# / 


/ 


HARS 


/ — 




— / /— 


— / — 






SOFT 


NICE 


/-*- 




— / / — 


— / — 






AWFUL 


COLO 


/ — 












HOT 


BAC 


/-”• 




— / 


—A ^ 






GOOD 


PEMlNiNE 






/_. 




— / — /— 


— / 


MASCULINE 








TEACHING CHILDREN SOCIAL STUDIES 



light 

ACTIVE 

HAPPY 

HELLISH 

$LC¥ 

negative 

CIFEICt'LT 

CPTIPISTIC 

STAONG 

HARO 

NICE 

HCT 

SAC 

FEP.ININE 




HEAVY 

PASSIVE 

SAD 

HEAVENLY 

FAST 

POSITIVE 

EASY 

PESSIMISTIC 

WEAK 

SOFT 

AWFUL 

COLD 

GOOD 

MASCULINE 



TEACHING CHILDREN 



U6KT 


/ — 
















HEAVY 


t> & C C T llC 
















. / 


ACTIVE 


PA55I Vc 


















SAD 


















HAPPY 


















HELLISH 






— / — 




— /- 






— / 


HEAVENLY 


SLC4( 


















FAST 


















PCSITIVE 


/ — 


— / — 














NEGATIVE 


DIFFICULT 


/ — 




— /— 




— 








EASY 


CPTIHISTIC 


/ — 




— /— 




— /- 






— / 


PESSIMISTIC 


STRONG 


/ — 








— 




-/ — 


—/ 


WEAK 


HARD 


/ — 


* 

i 








— / — 




— / 


SOFT 


NICE 


















AWFUL 


















COLO 


/ — 
















HOT 


U A P 


i 
















GOOD 


dAL 


















FEPININE 


/— 
















MASCULINE 



ERIC 
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teaching children science 



LIGHT 

PASSIVE 

HAfiPY 

HEAVENLY 

FAST 

negative 

EASY 

CPTIMISTIC 

VEAK 

SCFT 

AWFIL 

HCt 

GOCO 

FEPIMNE 



/ / / / / / / 

/ / 
/ — / — / — / — / — / — / — / 

/ — / — / — / — / — / — / — / 

/ / / / / / / / 

/ — / — / — / / / — / — / 

/ — / — / / / — / — ,/ — / 

/ — / — / — / / / — / — / 

/ — / — / — / — / — / — /— / 

/ / / / / /-*.—/ / 

/ / / / / / / / 

/ — / — / — / — / — / — / — / 



HEAVY 

ACTIVE 

SAD 

hellish 

SLOW 

POSITIVE 

DIFFICLIT 

PESSIMISTIC 

SiRONG 

HARO 

NICE 

COLD 

BAD 

MASCLLINE 



TEACHING children LANGUAGE ARTS 



HEAVY 

PASSIVE 

SAD 

HEAVENLY 

FAST 

NEGATIVE 

EASY 

PESSIMISTIC 

STRONG 

HARD 

NICE 

COLC 

6AC 

FEMININE 



/ / / / / / / 

/ / / / / / / / 

/ / / / / / / / 

/ / / / / / / 

/ / /-. / / / / / 

/ / / / -/ / / 

/ / / / / / 

/ / / / / / / / 

/ / / / / / / / 

/ / / / / / / 

^ I ■ H I — N IWI ^ ^ *** ^ / “• / **“ **“ ”** / 

/ /-.««-./ / / / / / 

/ / / / / / / / 



LIGHT 

ACTIVE 

HAPPY 

HELLISH 

SLOW 

POSITIVE 

OIFFICLLT 

OPTIMISTIC 

WEAK 

SOFT 

AWFUL 

HOT 

GOOD 

MASCULINE 




Appendix D 



.ilthcugb this 3D quest! znrrdire xas cci'.puter generated, 
C'f order effects vjere fixed. Tliat is, concept order ^ scale 
scale polarity are constant throughout the prcducticn run. 



all sources 
order, and 



1 



TH5 PUS^’e~CF this STUDY IS TO MEASURE THE KEANIKGS OF CERTAIN THINGS TO VARf 
j- CUS PEOPLE BY HAVING THEM JUDGE THEM AGAINST A SERIES OF DESCRIPTIVE SCAi.ES. 

IN TAKING THIS TEST, PLEASE MAKE YCUR JUDGEMENTS OF THE BASIS OF HHAT THESE TH 
VnGs'pEAN TC YCU. ON EACH PAGE OF THIS BOOKLET YOU WILL FIND A DIFFERENT CONC 
1 £0-T TC BE JUDGED AND BENEATH r A SET OF SCALES. YOU ARE TO RATE THE CONCEPT 
CN TACF CF THESES SCALES IN ORDER. HERE IS HOW YCU ARE TO USE THESE SCALES. 

] IF^TOL FEEL THAT THE CONCEPT AT THE TOP OF THIS PAGE IS VERY CLOSELY RELATED 
TO-CNE END CF THE SCALE, YOU SHOULD PLACE YOUR CHECK HARK AS FOLLOWS 






ffilR X 
- FAIR 



/ UNFAIR 

/ X UNFAIR 



'lE VOL FEEL THAT THE CONCEPT IS CUITE CLOSELY RELATED TO ONE OR THE OTHER END 
OF- THE SCALE IBUT NCT EXTREMELY!, YOU SHOULD PLACE YOUR MARK AS FOLLOWS 



STRCNG 



CR 



/ X 
STRCNG 



/ WEAK 

/ X / 



WEAK 



1 if' THE CONCEPT SEEMS ONLY SLIGHTLY RELATED TO ONE SIDE AS OPPOSED TO THE 
t CJKER SIDE {BUT IS NCT REALLY uEUIRALi. THEN YOU SHOULD CHECK AS FOLLOWS 



ACTIVE 

ca 



ACTIVE 



/ X / 

/ / 



/ / 

/ X / 



PASSIVE 
/ PASSIVE 



THe' dIRECTICN toward WHICH YOU CHECK (OF COURSE! CEPENDS UPON WHICH OF THE THI 
ENDS CF THE SCALE SEEM MOST CHARACTERISTIC OF THE THING YOU ARE JUDGING. 

IF YOL CCNSIOER T: I CONCEPT TO BE NEUTRAL ON THE SCALE, BOTH SIDES OF THE 
SCALE EOUALLY ASSOCIATED WITH THE CONCEPT, OR IF THE SCALc IS COMPLETELY 
IRREVELENJ . UNRELATED TO THE CONCEPT, THEN YCU SMULO MARK THE SCALE AS 



■ sm 



^PCllOV»S 

RiC 
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DANGEROUS 



S^FE / / / X / 

-^UPCRTANT - ID PLACE YOUR CHECK MARKS IN THE MIDDLE OF THE SPACESt NOT ON THE 

BOUNORIES / / ^ ^ 

(2) BE SURE YOU CHECK EVERY SCALE FOR EVERY CONCEPF DO NOT OKIT 

ANY 

(35 NEVER PUT MORE THAN ONE CHECK HARK ON A SINGLE SCALE* 

SCHETIHES YOU MAY FEEL AS THOUGH YCU HAVE HAC THE SAME ITEM BEFORE ON THE 
TEST. THIS WILL NOT BE THE CASE, SO DO NOT LOOK BACK AND FORTH THROUGH THE 
ITEMS. DC NOT TRY TC REMEMBER HCW YOU CHECKED SIMILAR ITEMS EARLIER IN THE 
T£ST^ DXl. NCT WORRY CR PUZZLE OVER INDiVIOUAL ITEMS. IT IS YOUR FIRST IKPRESSI 
CNS, TFE IMMEDIATE FEELINGS ABOUT THE ITEMS, THAT WE WANT. ON THE OTHER HAND 
PLEASE 00 NCT BE CARELESS, BECAUSE WE WANT YOUR TRUE IMPRESSIONS. 
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SCCIAL STUDIES 



HEAVY 




— / — 


— / 




/— 




/ 


-/ 


LIGHT 


ACTIVE 


/ 














-/ 


PASSIVE 


SAC 


/— * 
















HAPPY 


HEAVENLY 


/ 


—i — 


'•-/ 








/ 


-/ 


HELLISH 


SLCV 


— 
















FAST 


NEGATIVE 


/ 


— / — 


— / 








/ 


-/ 


POSITIVE 


CIFFICtLT 


- 




--/ 




— */ — 


— 


/ 


“/ 


EASY 


OPTIMISTIC 


/— 
















PESSIMISTIC 


kEAK 


/— 
















STRONG 


HARC 


/— 
















SOFT 


AWFcL 


/— 
















NICE 


CGLC 


/«.. 


— / 


— / 




— / — 




— /— 


-/ 


HOT 


GOCC 


/ 


— / 


— / 








— / 


-/ 


BAD 


FEMININE 


















MASCULINE 



ERIC 
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MATHEMATICS 



HEAVY 


/— 


-/ — 


— / 




/ — 






— / 


LIGHT 


ACTIVE 


— 




— / 










— / 


PASSIVE 


SAC 


/ 


“/ — 


— / 




/ — 




— /— 


— / 


HAPPY 


HEAVENLY 


/— 


-/ — 


— / 




/ — 


— /— 


— / — 


— / 


HELLISH 


SLCV 


/ 


-/ — 


— / 




— / — 


— / — 


— /— 


-«/ 


FAST 


NEGATIVE 




-/ — 


— / 




— -/ — 


— /*— 


— / — 


— / 


POSITIVE 


CIFFICCLT 


/— 


-/ — 


— / 




— / — 


— /— 




— / 


EASY 


CPTIMISTIC 




-/ — 


— / 




/ — 






— / 


PESSIMISTIC 


WEAK 


/ 
















STRONG 


HARC 


/ 


-/ — 


— / 










— / 


SOFT 


AHFIL 


/ 


-/ — 


— / 




1 




— 


— / 


NICE 


CQLC 


/ 









— / 






— / 


HOT 


GQCC 


/ 
















BAD 


FEMININE 


/ 
















MASCULINE 
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TEACHING CHILDREN HATHEHATICS 




T‘ 



J 




i 

.fi 

k\ 



t-EAVY 

ACTIVE 

SAC 

HEAVENLY 

SLOW 

NEGATIVE 

CIFFICLLT 



P- 

' 1 ; 



CPTLWISTIC 



aEAK 



HARE 



AWFLL 



i i 



f 






COLE 



GGCE 



FEMININE 



0 



/ / / / / / / / 

/ / / — / / / / — / 

/ / / / / / / / 



/ — / / / / / / 

/ / / — / / / / 



V 



/ / / / — -/ /— -/ / 

/ / / / / / 

/ / / / / /-- --/ / 

/ / / / / / 

/ / / /-- -w / — / / 

} / / / / / / / 

/ / / / / / / / 

/ / / / / / / / 

/ /— «— / / / / / / 




LIGHT 

PASSIVE 

HAPPY 

HELLISH 

FAST 

POSITIVE 

EASY 

PESSIMISTIC 

STRONG 

SOFT 

NICE 

HOT 

BAD 

MASCULINE 
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LANGUAGE ARTS 



/ / ' ' ' ' ' ‘ 


LIGHT 


iiCTIVEi / -*/ / ^ 1- t f f 


PASSIVE 


SAC / / — ^ / / / 


HAPPY 


HEAVENLY / / ^ / / / 


HELLISH 


3LCU / / f ^ 1 i f ^ 


FAST 


NEGATIVE / / / / / 


POSITIVE 


CIFfICLLT / / / ! ‘ ' 


EASY 


CPTIMISTIC / / / / ^ ^ ^ 


PESSIMISTIC 


WEAK / / ^ ^ /-- — / / / 


STRONG 


harc / / — ^ / / / / 


SOFT 


ahfil / — / / ^ ' / / / 


NICE 


COLC / f ^ ^ ^ / / / 


HOT 


GQCC / / / ^ ' / / / 


BAD 


FEHININE / /” / " / / / 


masculine 
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7 - 



SCIENCE 



HEAVY 


/— 
















L I GH 1 


ACTIVE 


/— 
















PASSIVE 


SAC 


/-“ 










/- 


/ — 




HAPPY 


HEAVENLY 


/— 
















HELLISH 


SLCV 


/— 
















FAST 


NEGATIVE 


/— 
















POSITIVE 


ClFFICtLT 


/-- • 










/- 


/ — 




EASY 


CPTIMISTIC 


/— 
















PESSIHISTIC 


^EAK 


/— 
















STRONG 


HARC 


/— 
















SOFT 


AWFIL 


















NICE 


COLC 


/— 
















HOT 


GOCC 


/— 
















BAD 


FEHIMNE 


/— 
















MASCULINE 



ERIC 
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TEACHING CHILDREN SOCIAL STUDIES 



HEAVY 

ACTIVE 

SAC 

HEAVENLY 

SLCV 

AEG/5TI VE 

CIFFICLLT 

CPTIHI STIC 

V»EAK 

HARC 

AWFLL 

COLC 

60CC 

r-Ef'lNINE 



/ / / / / / / / 

/ / / / / / 

/ / / / / / 

/ / / / / / / / 

/ / / / / / / / 

/ / / / / / / / 

/ / / / / / / / 

/ / / / / / 

/ / / / / / / / 

/ / / / / / / / 

/ / / / / / 

/ / / / / /- / / 

/ / / / / / / / 

/« / / / / / / 



LIGHT 

PASSIVE 

HAPPY 

HELLISH 

FAST 

POSITIVE 

EASY 

PESSIMISTIC 

STRONG 

SOFT 

NICE 

HOT 

6A0 

MASCULINE 



O ■ 

ERIC 



63 



teachimg children 



HEA\Y 

ACTIVE 

SAC 

HEAVENLY 

SLCk 

NEGATIVE 
CIFFIOJLT 
CPTIKISTIC 
NEAK 
HARC 
AWFIL 
COLC 
GOCC 

femnine 




LIGHT 

PASSIVE 

HAPPY 

HELLISH 

FAST 

POSITIVE 

EASY 

PESSIMISTIC 

STRONG 

SOFT 

NICE 

HOT 

BAD 

MASCULINE 
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TEACHING CHILDREN SCIENCE 



HEA\»Y 


/— 
















LIGHT 


1 ACTIVE 


/-* 
















PASSIVE 


i SAC 

t 


/- 
















HAPPY 


, 

HEAVENLY 


/- 
















HELLISH 


SLCV 


/- 
















FAST 


NEGATIVE 


/- 














/ 


POSITIVE 

FASY 


CIFFICLLT 


/- 














- -y 


PESSIMISTIC 


CPTIf-ISTIC 


/- 
















V»EAK 


/- 
















STRONG 


HARC 


/- 
















SOFT 


AWFLL 


/- 
















NICE 


COLC 


/- 














— / 


HOT 


GOCC 


/- 
















BAD 


FEMININE 


/- 
















MASCULINE 



t_ 



o 
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TEACHING CHILDREN LANGUAGE ARTS 



HEAVY 

ACTIVE 

SAC 

HEAVENLY 

SLCfc 

NEGATIVE 

DIFFICULT 

CPTIHISTIC 

ViEAK 

PARC 

AWFLL 

COLD 

GOCC 

FEMININE 



/ / / / / / / / 

/ / / / / / / / 

/ / / / / / / / 

f / / / / / / / 

/ «/ / / / /-'* — / ^ 

/J / / / / / / / 

/ / / / / / / 

/ / / / / / / / 

/ /- / / / / / / 

/ / / / / / 

/ / / / / / / / 

/ / ./ / / / 

/ / / / / / / -/ 

/ / / / / / / 



LIGHT 

PASSIVE 

HAPPY 

HELLISH 

FAST 

POSITIVE 

EASY 

PESSIMISTIC 

STRONG 

SOFT 

NICE 

HOT 

BAD 



/ 



masculine 



ii’fivsncij.:*: £ 



A reprcductioii of a 
contiol prozir -ity error 
Folloi.’iiic the progra. is 
reouired to generate the 



plTlxl 

n SD 



out Ox the CO, 
questionnaires 



,::puter program developed 
appears in this append’.: 



a reproduced print out of the data deck 
SD questionnaires used in this project- 



t 
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COMMON J0RDER(9»9) *IORDER( »ICON{9»80) ,KSCALE( 14?80) * 
1KKRNU5) »JCOjN(9*80) , JSCALE ( 14 , 80 ) » INST (585 ) , 169 » J69 »P0LCP > SCALOP 

2 , CONO P > NMBER > FM T 1 1 1 ) , h M T2 1 1 ) > N JM 

INTEGER CONOP, SCALOP»POLOP 
call iNOUTd 1,0,0) 

REAIH5,800) NMBER” 

800 FORMAT (1 11) 

CALL STORNM(NMBER) 

call IN0UT{ 9,0,0) 

NNN=0 

call INOUT (6, 1, 169) _ _ 

UO 27 J=2,1G9 

DO 26 1=1,169 

JORDER( I ,J)=JORDER( I ,J-D + 1 

iF ( JORDEki 1 , J ) I • 1 t>v ) bU iu Li5 
GO TO 25 

25 J0RDFR( I ,J)=J0R1’ER{ I ,J)-I69 

26 CONTiHUE 

27 CONTINUE 

CALL IN0UT(7,1,J69) 

DO 38 J=2,J6 9 

DO 37 1=1, J69 

lORDFRf I ,J) = IORDER( I ,J-D f 1 

IF( lORDERI I , J) »GT.J69) GO TO ~3 G 

GO TO 37 

36 IORDER( I ,J)=IORDER( I ,J)-J69 

37 CO f m -NtJ E “ 

38 CONTINUE 

call INOUT (1,1, 1 69) 

CALL IN0UT(2,1,J6 9 ) 

GO TO 955 

1 call GETNM(NMBER) 

CALL 3 T 0RNM(NM8 - ER -) 

CALL IN0UT( 11,0,0) 

NNN=0 

955 WRI T E(6>931) ' NM HER 

9*^1 FORMAT (5X,29HTHIS IS A NEW SERIES OF TESTS ,5X , 1 11// ) 

"i=0 

-J-=& 

P.LtS IF(CONOP.EQ.l) GO TO 521 
J=J+1 

IF (J. -E O T I69 + 1) CALL RAN5EL( 169,0, 533 r) 

IF(CONOP-NE.l) GO TO 211 
521 J=1 

211 DO 304 i-I - jI69 

IF(I.EQ.l) CALL INOUT(10,0,0) 

U=JORDER( I ,J) 

CALL INOUT-( -' 8 -r L>8 - 0 -) 

IF(SCAlOP.EQ.I) go TO 510 
M=M+1 

IF(M*CQ» J0 9 I 1) CALL RANSEL ( 14 

IF(SCALOP.NE.l) GO TO 217 
510 M=1 

217 CALL RANSEL( J6 9- »2 - » - S32 6 H 

DO 303 n=1,J69 
KL=IORDER(K,M) 



IF(F0L0P*EQ.1> call IN0UT(4»0,KL) 

IF(P0L0 ^ >£0»1 )"C 0 TO 5tT3 

N=KKRN{K)-2 

GO TO 611 . 

— 

611 IF(N)235 *239*610 

239 CALL IN0UT(4*0*K.L) 

bO 10 303 ■ 

235 CALL IN0UT(5*0*KL) 

302 CONTINUE 

GO lU 304 

320 00 325 J11=1*J69 
JL=KKRN(J11) 

DO 324 J12 = l*'g O 

324 JSCALE( J11*J12)=KSCALE ( JL*J12) 

325 continue 

DO B30 - J - 13 = l*J - 6 - 9 

DO 328 J14=i*80 

328 KSCALE(J13*J14)=JSCALE( J13*J14) 

330 LONTINUE 

M=1 

GO TO 217 

— 304 continue 

NNN=NNN+1 

IF(NNN*GT*NUW) GO 1 0 1 

GO TQ - 2^ 

331 DO 335 J15=1*I69 

NL=KKRN( J15) _ 

DO 334 J16=l*80 

334 JC0N(J15 *J16)=IC0N(NL*J16) 

335 CONTINUE 

DO 339 J10-l*I -fr 9 

DO 338 J19=l,80 

338 IC0N(J18*J19) = JCON ( J18 * J19 ) 

— 3 3 9 - C: - O trTtNUE 

J=1 

GO TO 211 

Em 

SIBFTC INOUTX 

SUBROUTINE I NOUT ( N * JFK * JKK ) 

CQ.^^MQN JORDERt9*9) * I ORDER! 14 * 14T T1 CON ( 9 *~3tn * KSCAr£TT4TBtn » ~ ~ 

1KKRN(15) yJCOM(9*80) * JSCALE ( 14* 80 ) *INST(585) * 1 69 * J69 *POLOP* SCALOP 
2»CONOP*NMBER*FMT1(1 ) ,FMT2( 1 ) »NU-' 

GO T O C6 ' OO*602* ' 6O4*605*b0b*b^/*bO9*6T l*bl3*6r5*616) *N 

600 DO 601 I=JFK*JKK 

READ(5*100) ( ICON( I *J) *J=1*80) 

gtn— C ON TI N UE 

RETURN 

602 DO 603 I=JFK*JKK 
— 6W3 READ(5*102) -r K -S CALE( I *J) *J^r T3tr) 

RETURN 

6U4 WRITE (6* 103) ( I CON (JFK* I ) * 1=1*80) 

RE T UR N ”7. 

605 wRITE( 6*104) ( KSCALE ( JKK * I ) * I = 1 * 15 ) * ( KSCALE ( JKK * I ) * I -i6 * ^0 ) 

RETURN 

606 WRrTC -1 6* 104) (KSCALE(JKK*I ) *1-16*30) *(KSCALE - r t mK ^~U-*-t^r*l^ - 

RETURN 

607 READ(5*FMT1 ) ( JORDER ( I *1 ) * i =JFK*JKK) 

■ RCT -U R N 

609 READ(5*FMT2) (IORDER(I*D *I=JFK*JKK) 

RETURN 
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I 



611 WRlTEt6»107) ( ICOr^( JFK,J) ,J = 1»JKK) 

RFTURT^ 

613 READ(5»108) ( INST ( I ) ,1=1,565) 

RETURN 

615 L'lR 1Tb 16,1111 

WRITE(6»109) ( INST ( I ) ,1=1,585) 

RETURN 

61 6~ -Re AD (5,110) CONO) , 5CALUP , POLOP ,NUr- ' . ,169, J 6 9 , t-M T T, FMT2 

RETURN 

100 FORMAT (80A1) 

1 02 FORMA T ( 3 OA I ) * 

103 FORMAT (80A1) 

104 FORMAT (//5X,15A1, 7 (5H/ ) , iH/ , 5X , 1 5A1 ) 

1 07 F ORMAT -T l - m,m5 X ,8t?Al,///1 

108 FORMAT (13A6) 

109 FORMAT (2X, 13A6/ ) 

rlO FORMAT T6 13 ,2A6) 

111 FORMAT (1 Hi) 

END 

— ft ANO tOT 

SUBROUTINE RANSEL ( I R , I RR ,* ) 

COMMON J0RDER(9,9) , lORDER ( 14, 14 ) , I CON ( 9 ,80 ) ,KSCALE ( 14,80 ) , 

I KKRN r 15 } , JCON C 9 , 8 0 7 , J5CALE C 1 4 , 80 T , I W 6T C58 5 ), 1 6^,069, POLOP , SC ALOP , 

2C0N0P,NMBER,FMT1 ( 1 ) ,FMT2 ( 1 ) ,NUM 
DO 441 I=1,IR 

404 Y = F LRAN (> n 

A=ABS(Y) 

KKL =A*100, 

IF^l KiCL. E Gi ' O) GO T O 404 

IF(KKl.GT.IR) 60 TO 300 
IF( I .EO. 1) 60 TO 4ne 

G O T O 301 

300 KKL=KKL/10 



IF( I.EO.l) GO TO 406 

— ^ - 1 Jl ^ M 

DO 439 J=1,J1 

439 IF (KKL.EQ.K'KRN( J) ) 60 TO 404 

406 It ffim -r ) -KK.1- 

441 CONTINUE 

IF( IRR.EQ.2) 60 TO 419 

R E TU R N - 1 

419 RE I URN 
END 

^jIBMAP RANDPK. 

ENTRY EXPRN 

entry 6AURN 

ENT - RY FtrRAN 

entry GETNM 

ENTRY STORNM 

- CX P RN EDO RtWEOM 

C PXD 952,0 

H STA A 

ME¥ GENE R A 

STQ COMMON+1 

STO COMMON 

-F MRY SEttERA 

STQ RANDOM 

CLA COMMON 

TEQ B 

LDQ COMMON+1 

RQL 12 



RA:N&WOOO““ 

RAiNDMOOl 

RANDM002 



RANDM004 

RANDM005 

RANDM007 



RANDM008 

RANOMO'09 — 

RANDMOlO 

rancmoi* 

RANDMCrl:2“ 

RANDM013 

RANDM014 

RANOMO^l 5 — 

RANDM016 

RANDN'017 
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CAL 


c 


RANDM018 




LGL 


24 


RANDM0X9~ 




STO 


COMMON 


RA?-:DMC20 




CLA 


A 


RANDM021 




LLo 


12 


■■ 


E 


FAD 


COMMON 


RANDM023 


G 


TNZ 


1,4 


RANDM024 




1 R7T 


£ 


RANDMU'2'5' ' 


B 


MPY 


GENERA 


RANDM026 




STQ 


COMMON 


RANDM027 




Cla 


RAr^DO'-i 


P.AMDM028 




TLQ 


F 


RANDM029 




CLA 


A 


RAN DM0 30 




ADM 


G 


RANDM031 




TRA 


H 


RANDM032 


GAURN- 


SXD 


COMMON-J-3,4 


RANDM033 


cc 


"TSX 


E>.PRN,4 


RANDMU34 




ADD 


AA 


RANDM035 




STO 


CCMM0N*^4 


RANDM036 




1 3X 


EXPRN,*.- 


RANDM037 




STO 


COMMON 


RANDM038 




FSB 


BB 


RANDM039 




o 1 U 




RANDM040 




LDQ 


COMMON-J-1 


RANDM041 




FMP 

4H- 


COMMON-*-] 


RAN0M042 




oU L) 


UUrlNUN *4 " 


KANDM043 




TPL 


cc 


RANDM044 




LXD 

-etrA 


COMMON-J-3 ,4 

C-OMMON 


RANDM045 

RANDM046 



LDQ 
RQL 

tts- 

TRA 

FLRAN LDQ 



RANDOM 

20 

-e 

1,A 

RANDOM 



RANDM047 

RANDM048 

RANDTT049 

RANDM050 

RANDM051 



MPY 


GENERA 


RANDFrCT52~ 


STQ 


RANDOM 


RANDM053 


CLA 


AAA 


RANDM054 


LGL 


28 


RANDM055 


FAD 


AAA 


RANDM056 


TRA 

-ee-T-NM — etA — 


S 

RA-NDOM 


RANDM057 

RAMPiMfi 



> - TORNM - 



STO* 

TRA 

-e L/ r » 



- OE - NCRA 
RANDOM DEC 
AA OCT 
- &B - 



3.4 

1.4 



fTO RANDOM 

TRA 1,4 

-eer 3^3277244615 



RANDM059 

RANDM060 



RANDN'i062 

RANDM063 



D€e 

AAA OCT 
A OCT 

- C -OM MON - BSS 



30517578125 

001000000000 



172000000100 
00021700000 
-5 



RANDM065 
RANDM066 
- RANDMOS T^ 
RANDM058 
RANDM069 
- RANOM0 70 - 
RANDM071 



end 

$DATA 

i i 9- 14 ^ (9T2) (1412) — 

30517578125 

THE PURPOSE OF THIS S**UDY IS TO 
■ 6US - - PEOPLE D^ r HAViNQ THEM JUDGE 



MEASURE THE MEA 
- THEM AGAINST A ■ 



IN TAKING THIS TEST, PLEASE MAKE 
INGS MEAN TO YOU. ON EACH PAGE 



.-NGS OF CERTAIN 
i-tKIta 



YOUR JUDGEMENTS OF THE BASIS 
OF THIS BOOKLET YOU WILL FIND 



things to VAR I 
tn rS LR - tP TtVE ' St. ALES. 



OF WHAT THESE TH 
A DIFFERENT CONC 
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-PT TO Junr«5^r> 

ON EACH CF theses SCALES IN 
IF TOU F = Fl that the CC'^StC-'' 
TO ONE END OF THE SCALE, YOU 



IT A SET SCALFS. YO'J APc TH OATE Tr* 
CFOEP. HEHE is HD.% YOU ARE TO USE' THESE 
Twp T'~P O'" T-;I' I* Vi-**' CLOSEL^ 

SHOULD PLACE YOuR ChEC?1 AS FOLLOWS 



CONCEPT 

CALES. 

ir- I # nr ^ 



FAIRX/ / / / / / UNFAIR 

OR FAIR / / / / / / •< UNFAIR 



IF YOU FEEL THAT THE CONCEPT IS QUITE CLOSELY RELATED TO ONE OR THE OTHER FND 
OF THE SCALE (BUT NOT EXTREMELY), YOU SHOULD PLACE YOuR RARK AS FOLLOWS 



STRONG / X / / / / / ■'EAK 

OR ‘STRONG / / / / / X / ^A< 



IF THE CONCEPT SEEMS ONLY "^LIGHTLY oflATFD TO ONE SIDE AS OPPOSED TO THE 
OTHER SIDE (BUT IS NOT REALLY NEUTRAL), THEN YOU SHOULD CHECK AS FOLLOWS 



ACTIVE / / X / / / / PASSIVE 

OR ACTIVE / / / / X / / PASSIVE 



THE DIRECTION TOWARD WHICH YOU CHECK (OF CC'JRS^) DEPENDS UPON WHICH OF THE TWO 
ENDS OF THF SCALE SEEM MOST CHARACTERISTIC CF THE THING YOU ARE JUDGING. 

I F YOU CONSIDER T H£ - CONCEP T TO~ ^ E NE UT R A L t)N T HE SCAL - £, -S O T H 5 T-DE 5 -OF~THr 
SCALE EQUALLY ASSOCIATED WITH THE ConcEDt, OR IF THE SCALE IS COMPLETELY 
IRREVELENT , UNRELATED TO THC CONCERT, THE'^' YOU SmquLD MARK THE SCALE AS 
FOLLOVrS 



SAFE 



IMPORTANT 



( 1 ) 

t-2-I 

(S) 



/ / / X / / / DANGEROUS 



PLACE YOUR CHECK MARKS IN THE MIDDLE OF ThE SPACES, NOT ON THE 
BOUNDRTES / / X / 

BE SURu YOU CHECK EVER T SCALE - T tO R -gvet^ : Y CONCEPT DO-N01-OM-i"T 

ANY 

NEVER PUT MORE THAN ONE CHECK MARK ON A SINGLE SCALE. 



SOMETIMES YOU MAY FEEL AS THOUGH YOU HAVE HAD THE SAME ITEM BEFORE ON THE 
TEST, This will not be the case, sc do not look back AMD FORTH THROUGH THE 

I - T - E ~ MS ~5 DO not TR Y TO REMEMBER ~ H0W YOU CHECKED SIMILAR ITEMS E/^RLink IN THE 

TEST. DO NOT WORRY OR PUZZLE OVER INDIVIDUAL ITEMS, IT IS YOUR FIRST IMPRESSI 
ONS, THE IMMEDIATE FEELINGS ABOUT ThE ITEMS, THAT WE VJANT , ON THE OTHEI^H/^^ 
P L E ASE DO NO T BE CA'RELESS, Bb CAUSE wE WAn F yuUR iKUh iMPKtbblONSV 
125734968 

1 3 2 9 611 71314 41210 58 

SOCIAL S T UDT -ES 

MATHEMATICS 

SCIENCE 

TEACHING CHi t OREN SOCIAL S TUDIES 
teaching children MATHEM/^IICS 

teaching children science 

language - A R - T 3 

TEACHING CHILDREN LANGUAGE ARTS 

teaching children 

HEAVY LIGHT 

SAD HAPPY 

ACTIVE PASSIVE 

-HTSrRD SOFT 

GOOD BAD 

SLOW FAST 

Dirricu b T eatsty 

FEMININE MASCULINE 

HEAVENLY HELLISH 
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COLD HOT 

tTEt j-ATlvE- P- OSI T IVE 

AWFUL NICE 

OPTIMISTIC PESSIMISTIC 

VEAK S T RONU 

1 i 8100 9 lA (9I2)(14I2) 



-T 



I 

I 



)i 

L . 

I 



II 

O 

me 
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